Efficient Convergence Implies Ockham’s Razor
نویسنده
چکیده
A finite data set is consistent with infinitely many alternative theories. Scientific realists recommend that we prefer the simplest one. Anti-realists ask how a fixed simplicity bias could track the truth when the truth might be complex. It is no solution to impose a prior probability distribution biased toward simplicity, for such a distribution merely embodies the bias at issue without explaining its efficacy. In this note, I argue, on the basis of computational learning theory, that a fixed simplicity bias is necessary if inquiry is to converge to the right answer efficiently, whatever the right answer might be. Efficiency is understood in the sense of minimizing the least fixed bound on retractions or errors prior
منابع مشابه
Ockham's Razor, Truth, and Information
In science, one faces the problem of selecting the true theory from a range of alternative theories. The typical response is to select the simplest theory compatible with available evidence, on the authority of “Ockham’s Razor”. But how can a fixed bias toward simplicity help one find possibly complex truths? A short survey of standard answers to this question reveals them to be either wishful,...
متن کاملOckham’s Razor, Hume’s Problem, Ellsberg’s Paradox, Dilation, and Optimal Truth Conduciveness
Classical Bayesianism represents ignorance, if at all, by flatness of prior probabilities. Such probabilities are an essential part of the standard Bayesian explanation of Ockham’s razor. But flatness as a model of ignorance is called into question by Ellsberg’s paradox, which has led to the consideration of incoherent or inexact degrees of belief, both of which undermine the usual explanation ...
متن کاملTestability and Ockham's Razor: How Formal and Statistical Learning Theory Converge in the New Riddle of Induction
Nelson Goodman’s new riddle of induction forcefully illustrates a basic challenge that must be confronted by any adequate theory of inductive inference: provide some basis for choosing among alternative hypotheses that fit past data but make divergent predictions. One response to this challenge is to appeal to some version of Ockham’s razor, according to which simpler hypotheses should be prefe...
متن کاملLearning, Simplicity, Truth, and Misinformation
Both in learning and in natural science, one faces the problem of selecting among a range of theories, all of which are compatible with the available evidence. The traditional response to this problem has been to select the simplest such theory on the basis of “Ockham’s Razor”. But how can a fixed bias toward simplicity help us find possibly complex truths? I survey the current, textbook answer...
متن کاملOckham's razor, empirical complexity, and truth-finding efficiency
The nature of empirical simplicity and its relationship to scientific truth are long-standing puzzles. In this paper, empirical simplicity is explicated in terms of empirical effects, which are defined in terms of the structure of the inference problem addressed. Problem instances are classified according to the number of empirical effects they present. Simple answers are satisfied by simple wo...
متن کامل